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Abstract. The second law of thermodynamics dictates the fundamental limits to the 
amount of energy and information that can be exchanged between physical systems. 
In this work, we extend a thermodynamic formalism describing this flow of energy and 
information developed for a pair of bipartite systems to many multipartite systems. We 
identify a natural thermodynamic quantity that describes the information exchanged 
among these systems. We then introduce and discuss a refined version. Our results 
are illustrated with a model of two, competing Maxwell demons. 
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The role of information in thermodynamics has a long history, from Maxwell’s demon 
to Szilard’s engine and on to the investigations of Bennet, Landauer, and Penrose 00. 
Today, there has a been a resurgence in studying this old theme spurred on by 
both experimental and theoretical progress in our understanding of small fluctuating 
systems. In the laboratory, increased control over small systems has led to the 
experimental verification of fundamental ideas OT, such as Landauer’s principle 
Concurrently, the development of stochastic thermodynamics has provided a robust 
theoretical framework that can naturally include information HUM- 

This progress has lead to a number of systematic methods to incorporate 
information into the thermodynamics side-by-side with energy and entropy mm 
fl2l fl8l Hil fl5l m El m H3 EH EH E2]- For the special class of bipartite systems, 
the information flow specifically has been identified as a useful thermodynamic measure 
of information [23] El) E3 ES E2j- A pair of thermodynamic systems, say X and Y, 
is bipartite if the fluctuations in each system are independent. When the dynamics is 
modeled as a Markov jump process, then the two systems never jump simultaneously, 
only one at a time; whereas for diffusion processes, each system experiences independent, 
uncorrelated noise. For such bipartite systems, the second law of thermodynamics can 
be split into two distinct, positive contributions, leading to an (irreversible) entropy 
production for each system individually [25> G3, [27J EEJ, 

sj c = d t s(x) + sZ B -i x > o 

= dtS(Y) + Sj es - i Y > 0. 

Each half contains the customary contributions from the time variation of each systems’ 
Shannon entropy, d t S(X ) and d t S(Y ), and the rate of reversible entropy exchange with 
each of their environmental reservoirs, S x s and Sfl es : as an example, imagine thermal 
reservoirs where these contributions are proportional to heat, e.g., S x s = Q x /T. The 
two new contributions, I x and P , represent the flow of information into and out of 
each system and are given by the rate of change of the mutual information between X 
and Y due to their own fluctuations. Here, the notation dt emphasizes a time derivative 
of a state function, as opposed to the over-dot signifying thermodynamic flows, such 
as entropy or heat. This information-flow framework is already finding applications, as 
in [25] where it was applied to study the energetic efficiency of information processing 
in cellular sensing and adaptation. 

In this article, we expand the applicability of this formalism to N multipartite 
systems: a collection of systems where each one experiences independent noise. Here, 
the information-theoretic quantity is the information flow between each system and 
all the rest. We then refine this statement by recognizing that the dynamics of any 
particular system is only affected by a small group of the other systems, what we call 
its neighbors. As a result, only its neighbors can influence its thermodynamics, allowing 
us to tighten the second law with information by restricting the information flow to 
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just neighbors. We then conclude with an analysis of linear systems and illustrate these 


results with a pair of competing Maxwell demons. 

2. Dynamics of multipartite systems 

We begin our discussion with a description of the dynamics. Onr results will apply to any 
thermodynamically consistent Markovian dynamics [9], but for our narrative we consider 
over-damped diffusion processes, because the notation is the most concise. Equivalent 
results for underdamped diffusions and Markov jump processes follow similarly. 

We have in mind a collection of N systems X = (A 1; • • •, Ajv), with states 
x = (x±, ..., Xn). While we allow arbitrary interactions among the systems, we do 
require that each system, like X k , is coupled individually to a distinct thermal reservoir 
with temperature T k . This splitting of the environments is the multipartite assumption 
and will allow us to uniquely identify the thermodynamic flows moving into and out 
of each system. Since the environments are distinct, the dynamics segregate, and the 
Fokker-Planck equation for the time-dependent probability density pflx) |30], 


N 



( 2 ) 


k =1 

separately includes one (probability) current for each system, 
J k {x,t) = p k F k (x, A t )pt(x) - p k T k d k p t (x ), 


( 3 ) 


with mobility /x k and force F k depending on time-dependent, externally-controlled 
parameters A*. Here and throughout, we fix Boltzmann’s constant to k-Q = 1. If 
the dynamics were not multipartite, then each J k would include thermal fluctuations 
induced by thermal reservoirs different from the k- th, which would manifest itself by 
the inclusion of a term like fi k {Fidip for i k in J k . Alternatively, on the level of 
individual trajectories, the multipartite assumption restricts the form of the coupled 
Langevin equations ESI by requiring the noise driving each system to be uncorrelated. 

The multipartite structure has an important consequence that we will exploit in 
the following as we develop a thermodynamics of interacting systems. Namely, any 
linear functional of the currents, what we will call a flow, can be divided into separate 
contributions arising from each current individually. Specifically, for a generic flow we 
have 



( 4 ) 


which has a piece separately due to each current { J k }. 


3. Thermodynamics of information flow 


For a collection of N systems with Markovian dynamics as in ([2]), the second law of 
thermodynamics bounds the (irreversible) entropy production rate as [9j 131] 
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where the first piece is the rate of change of the systems’ Shannon entropy S(X) = 
-/ p t (x)hipt(x) dag 


N 


N 


d t S(X ) = J2S k ( x ) = ~J2 [ Jk(x,t)d k lnp t (x)dx (6) 

k =1 k =1 d 

and the second term is the the entropy flow into the environmental reservoirs, 

N Qk N i r 

Sres = ~X~ = A i) da b ( 7 ) 

due to the heat flow into the each reservoir Q k p, 151] . Summing (|6]) and (JtJ) , gives a 
compact expression for the entropy production 

N N 


k =1 fe=l rK K J 


Pt{x) 


dan 


( 8 ) 


Importantly, each of the quantities entering the second law is a flow, with each 
current contributing separately, due to the multipartite structure. The result is that the 
second law holds for each system individually; specifically for Xk we have 

sf = S k (X) + %- > 0, (9) 

J-k 

with each term representing the contribution to the entropy production coming from the 
k-th environment’s thermal perturbations of X k . We can rehne this statement slightly, 
by recognizing that the environmental perturbations due to the k-th environment only 
affect X k directly and all the other systems X_ k — (• • •, X k _x, X k+ ^ ■ ■ •) are only 
disturbed indirectly. As a result, S k (X ) equals the variation in the conditional entropy 
S(X k \X_ k ) = - Jp t (x) \np t (x k \x- k ) da? of X k given 

= J J k (xfl)d k \np t {x k \x- k )dx = S\X k |X_ fc ), (10) 

where p(x k \x_ k ) = p(x)/p(x_ k ). Thus, the second law for X k takes the form 

S k = S k (X k \X_ k ) + > 0. (11) 

a k 

Next, to generalize (jl]), we recognize that S k (X k \X_ k ) contains in it the variation 
in the correlations between X k and all the other systems X_ k . Our goal is to make 
these correlations explicit. To this end, we use the mutual information, defined for any 
pair of random variables U and V with joint probability density p(u, v ) as [32J 


HU ; V) 


S(U ) - S(U\V) = S(V) - S(V\U ) 
P(u,v) 

p(u)p[v) 


p(u , v) In 


dwdu, 


( 12 ) 


in = 1 units. / is symmetric and always positive, I > 0, being zero only when U and 
V are independent. As such, it is a information-theoretic measure of correlations. 

To incorporate the mutual information into our second law for X k in ( JlT| ) , we start 
by noting that the mutual information’s time derivative is a flow, d t I = I k , and that 
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Figure 1 . Illustration of neighbors: Three systems X, Mi and M 2 influence each 
other’s dynamics inducing forces on each other pictured as directed arrows. X has two 
neighbors influencing its dynamics, while the unique neighbor of both M\ and M 2 is 

X. 


its relationship with the entropy (12) holds on the level of flows. In particular, for the 
mutual information between X k and X_ k we have 


i k (X k -X_ k ) =d t S(X k )-S k (X k \X_ k ) = I J k (x,t)d k lnp t (x_ k \x k )dx.(l3) 

Here, it is important to recognize that the total time derivative of S(X k ) is equal to its 
flow in the fc-th direction, since it can only change due to the environmental fluctuations 
of the fc-tli reservoir: d t S(X k ) = S k (X k ). This information flow quantifies how X k s 
fluctuations affect its correlations with the other systems. For example, I k > 0 signifies 
that X k is gathering information and learning about the other systems, since /( X k ; X_ k ) 
is increasing on average as X k evolves. With this identification, can readily be 
rewritten as 

S k = d t S(X k ) + i k (X k ; X_ k ) > 0. (14) 

J-k 

This expression describes the information flow’s effect on the entropy balance of X k . To 
get a feel for its implications, imagine for the moment that X k were alone. In this case, 
we would identify a k = d t S(X k ) + Q k /T k as its entropy production [cf. (JHJ)] , which the 
second law would require to be positive. However, the presence of the extra systems 
allows for the possibility that the entropy of X k and its environment decreases, a k < 0. 
In other words, when I k < 0 the information flow acts as a resource, allowing X k to 
perform otherwise impossible tasks, like cyclically extracting heat from its reservoir and 
turning it into work, in seeming violation of the Kelvin-Planck statement of the second 
law |33J. 


4. Refined information flow 


We can refine (14) by recognizing that X k can only directly learn about those systems 
with which it interacts - those that directly influence its dynamics — and that any 
information it has about the other systems comes indirectly. To make this notion 
precise, imagine that the force on X k only depends on a subset of all the systems 
C — k , its neighbors, z.e., F)c — F k flx k ^ Xq^^ .X^). .A.S a result, the time variation 
of X k at any moment only depends on the states of its neighbors. This idea is 
schematically illustrated for a tripartite system in fig. [TJ With this division in mind, 


we can split the information flow, using the definition of mutual information (12), as 
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i k (X k ;X_ k ) = i k (X k \ XqJ + i k (X k ] X-n k \Xn k ) into an information flow with just 
X k s neighbors I k (X k : X klk ) and an information flow with all the remaining systems 
X_Q fc = X/{X k , Xn k } given X k 's neighbors, I k (X k ; X_njX n J. The utility of this 


splitting will become apparent in the following, where we show that (14) can be split 
into two positive contributions, 


d t S{X k 


+ X t ;X a J>0 

J-k 


1 1 {X,..X ,,, Xt.i > 0. 


(15) 

(16) 


Together (15) and (16) give a more precise relationship between entropy (or free 
energy) and information than our original bound in ( [14) ). Even though X k may increase 
its information about X_ klk by way of I k (X k ] X_n fc ) > 0, when we exclude those 
indirect correlations, X k has no way to gather information about its non-neighbors. 
Thus, we must have I k (X k , X_ci k \X^ k ) < 0. By contrast, X k can directly learn about 
its neighbors, I k (X k : Xn k ) > 0, which costs entropy a k = d t S(X k ) + Q k /T k . From 
the opposite perspective, the only information available to perform a useful task, which 
would make a k < 0, is the information between X k and its neighbors. A similar splitting 
was introduced in [3TJ to study the thermodynamics of cellular sensory adaptation in 
E. Coli chemotaxis. 


The arguments leading to (15) and (16) follow from properties of the entropy 


production rate for Markov processes [34j. To demonstrate the positivity of (15), we 
coarse-grain the dynamics by integrating out all the systems that are not neighbors 
of X k , namely . For this reduced set of systems, the entropy production rate 

reduces j35], 36,, [37], in analogy to (J8]) , to 

1 f J%(x k ,xn k ,t) 


S; = 


l^kEfc J Pt{x kl X^i 1 fl 
with the coarse-grained current 


dx fc da;n fc > 0, 


(17) 


(18) 


J k (x k ,xa k ,t) = J J k (x,t) dx_ nk 

hfcAfc((Cfc, Xfi k , X t )p t (x k , n k T k d k pflx k , XQ k f 

Now the fact that F k only depends on the neighbors of X k becomes crucial: The current 
maintains the exact same structure as before in (J3]) , except now just for X k and its 
neighbors X$i k . Furthermore, J k is the only part of the current that enters Q k in 
that is, 


k - 


Q k = / Jk(x k ,x nk ,t)F k (x k ,x nk , X t )dx k dx 


Oi, ■ 


(19) 


Therefore, we can carry through the exact same steps in deriving (14) to conclude that 


§ k = d t S(X k ) i k {X k - Xn k ) > 0. 

J-k 


( 20 ) 
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On the other hand, (16) follows almost directly from its definition 

p t (x k ,x-n k \xn k 


I k (X k -,X_ ak \X nh )= / J k (x,t)d k ln 


da? (21) 


j)t(x k \xn h )pt(x-n k \xa h 
= J p t (x_ k )D k \p t (x k \x_ k )\\p t (x k \xn k )\dx_ k , (22) 

where we have identified D k as the flow of a relative entropy [D(f\\g) = 

f f{x) ln[f (x) / g(x)]dx] due to the fluctuations of just X k . Since the evolution equation 
at time t with just X k s dynamics, i.e., d t pt(x ) = —d k J k (x,t), is a Markovian master 
equation, it will always generate a decrease in a relative entropy, D k < 0 [38] . and (16) 
follows. 


5. Connection to transfer entropy rate 

Having introduced the information flow for multipartite systems, it is important to 
place this result in the context of the other ways information can be included in 
thermodynamics. In particular, Ito and Sagawa have shown that for many interacting 
systems the transfer entropy rate can also bound the thermodynamics [18]. Namely, the 
entropy production in the k-th system is bounded as 


= d t S(X k ) + %- > 
J-k 


-I(X k -> X n „), 


(23) 


where I(X k —> Xn k ) > 0 is the transfer entropy rate from X k to its neighbors [39 


Equation (23) codifies how the transfer entropy is a resource like the information flow, 
allowing for a k < 0. In [18], the transfer entropy rate is explicitly defined for discrete¬ 


time dynamics, which is advantageous here because this discrete-time formalism will 
facilitate our connection with the information flow. To this end, we consider a trajectory 
of our systems during a time interval of length T. Time is discretized by breaking it up 
into M intervals of length At = T/M , and we label each discrete time as t a = a At, for 
a = 0,..., M. The systems’ position at t a is denoted as X(t a ) = X(a) and a trajectory 
up to that time is Xf = {X(/3)}^ =0 . With this setup the transfer entropy in the a step 
is given as the mutual information PUCES] 

I(X k ^X Qk ) =I[X k (a-l);Xa k (a)l(X c 


Jo" 1 ] 


= / pm ° - 1), («] m p[ ^ ( ^ ( ;~ 1) ’; n - 1 ( r~ 1)] d**d ( *oo“. 

J PFn h (a)|(a:n fc )S ] 

Then the continuous-time transfer entropy rate is obtained in the limit At —y 0 as 
/( X k —> Xn k ) = liniAt^o I{X k —> Xn k )/At. The transfer entropy is an information- 
theoretic measure of how much the dynamics of X^ k are perturbed by X k . In this way 
it offers a measure of the amount of information transferred from X k to its neighbors. 

We will show that the transfer entropy rate gives an upper bound on the information 
flow as 

i(X t ^X ah )>J2!'(X t ;X a J, 

l£flk 


(24) 


( 25 ) 
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and thus measures the maximum amount of information that can flow into the neighbors 
of X k . The thermodynamic implications of the bound in (25) are most strikingly 
demonstrated in the steady state where all total time derivatives are zero, like dtS(X k ) = 
0, and are summarized by the series of inequalities 

-%< ~i k (X k : X n J = ^ HZ* X Qk ) < I(X k X r 




(26) 


iefife 


where the middle equality follows from the fact that the total-time derivative of the 
mutual information in the steady state is zero: d t I = ^ I 1 = 0. Equation (26) shows 
how the amount of heat that can be pulled out of the h-reservoir Q k (as work) is bounded 
by the information flow due to system k, which is ultimately bounded by the transfer 
entropy rate to X k s neighbors. A similar analysis for two interacting systems was 
presented in [28], and there it was shown that the upper bound on the information flow 
can be achieved when the auxiliary system implements the Kalman-Bucy filter 


To demonstrate (25), we follow the arguments of [26] for two systems. We start by 
employing the definition of the conditional probability to rewrite the transfer entropy 
([24 ) as 


f(X t -► XnJ = ( In 


p\xn t (a)\x k (a - l),in,(a - l)]ppn,) 


a— In 


p[(x n 


kJOi 


(27) 


where angled brackets denote an average over trajectories. We then apply the log-sum 
inequality [32] to (X^Jq -2 : 

p[x nk (a)\x k (a - 1 ),®n fc (a - 1)] 


I{X k -)■ X n J > ( hi 
= ( In 


p[x nk (a)\xa k {a - 1)} 
p[xn k (a),xn k (a - l)\x k (a - 1)] 


In 


(28) 

p[(r Qfc (a-l)|x fc (a-l)] o \ 
P[xa k {a- 1 )] 


p[xn k (a),xn k (a-l)] 

One last application of the log-sum inequality on Xn k (ct — 1) in the first term brings us 


to 


I(X k ^ X n J > ( In 


p[x nk (a)\x k (a - 1)] 


— ( In 


p[xn k (a - 1 )| x k (a - 1 )] 


(30) 


P[*n*( Q! )] / \ P[&n k (a- 1)] 

The right-hand-side is now the discrete-time definition of the information flow. We can 
see this by expanding the p[x^ k (a), xflcx — 1)] hidden under the brackets in the first term 
to order At using the Fokker-Planck equation (|2]). Noting that it is only the neighbors 
that progress in time in (30), we have 

p[x nk (a), x k (a - 1)] » p[xn k {a ~ 1 ),x k (a - 1)] - At ^ d t J l [x nk (a - 1 ),x k (a - 1)].(31) 

ieQ k 

Substituting this into the first term of (30) gives our desired result 

p[x Qk (a - l)\x k (a - 1)] 


/(X fc -» XqJ > At ^ / J l [x Uk (a - l),x k (a - l)\diln 


l£tt k ' 


p[x a ^a- 1)] 


(32) 


iefi k 

after taking At —» 0. 


( 33 ) 
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6.1. Linear systems 


To illustrate the above discussion, we consider a linear system with forces 


F(X) = -A X + f, 


(34) 


in terms of a time-independent invertible matrix A with strictly positive eigenvalues, 
and constant vector f. For such constant coupling, the systems will relax to a Gaussian 
steady state 


Pss(X) = 


exp 


■-(X 
2 v 


m)E _i (X — m) 


(35) 


y(2ir) K |E| 

characterized by the means m = A -1 / and the covariance matrix E, given as the 
solution of (/iA)E + E(/rA) 3 = O, with diagonal matrices p and O whose elements are 
pki Pk^ki and B/j/ 2 p k T k d k i. 

It is then a straightforward exercise in integral calculus to determine the steady- 
state information flow from (13), 


i k (X k ; X_ k ) — p k (A fcfc — TfcE^ 1 ) , 


(36) 


after some simplifications exploiting the algebraic equation for E. For the information 
flow to Xfls neighbors, we need the covariance matrix of just X k and its neighbors, E n G 
which is obtained by projecting E onto the subspace of X k and X^ k . Then, 

I k (X k ; X n J = p k {X kk - T k { E^)’ 1 ) . (37) 

As a result, the information flow between X k and its non-neighbors given its neighbors 

is 


Aa*I x_ n ,|X n J = -ton (E^ 1 - (E n *)i) < 0, (38) 

Finally, from ([7]) the heat flow into the fc-th reservoir is 

Q h — Lk [(AEA T ) fcfc — T k A kk ] . (39) 


6.2. Two Maxwell demons 

An intriguing application of the above formulas is to consider a system manipulated 
by two Maxwell demons. We take as our system of interest an overdamped Brownian 
particle X trapped in a harmonic well of strength k, with mobility /i in thermal contact 
with a thermal reservoir at temperature T — 1, fixing the units of energy. Its dynamics 
are given by the Langevin equation 

x t = —p(kx t - ht) + (40) 

with zero-mean Gaussian white noise of covariance (£t£ s ) = 2 p,5{t — s). Here, h t is an 
external force, which the two Maxwell demons are going to manipulate using feedback 
in order to extract work. For concreteness, we identify the internal energy of the particle 
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as solely due to the harmonic trap: u = As a result, we have from stochastic 

energetics [7j that the rate at which work is extracted by h t is 

w ext = -h t o dx t , (41) 

where o denotes a Stranovich integral. 

Feedback is implemented by a pair of identical Maxwell demons M 1 and M 2 , 
which we model as two Brownian particles with positions my and m 2}t . Each demon 
continuously monitors the position of X and records those measurements in its own 
position dynamically through the pair of Langevin equations 


= -vk d (m if -x,)+ rn ,,, 


(42) 


for i — 1,2, with k^ their spring constant, v the mobility and rj iyt uncorrelated zero- 
mean Gaussian white noises of covariance (Tj t jjj JS ) = 2 uSijdfl — s), uncorrelated with 
These interactions lead to the neighbor structure illustrated in figure [l] The information 
acquired by the demons is fed back as a force h t = apmij + a 2 m 2jt designed to extract 
an average work from A°s thermal fluctuations, 


W ext = (w ext ) — — J Jx(x,mi,m 2 ,t)(aimi + a 2 m 2 ) dxdmidm 2 

= + wy 


(43) 


ext i 


where we have separated out the work extracted by each demon individually. 

Now, in the steady state the Erst law of thermodynamics demands that W ext = 


Q x , and the information-flow inequality in (|20|) becomes 


hF ext < 


I x (X-M u M, 


(44) 


Thus, the amount of work extracted by the demons is bounded by the amount of 
information consumed by A". We demonstrate this in figure [2] using the formulas of 
section 6.1 Of course, the ultimate source of this information are the two demons, 


which must supply heat in accordance with the refined information-flow inequality in 

PI, 


Q m 1 > i Ml (A; Mi), Q m 2 > i M2 (A; M 2 ), 


(45) 


as verified in figure |3j Remarkably, the work extracted by each demon individually 
is bounded by the information it has: W^f < / Mi (A; Mf), i = 1,2. How general 
this observation is remains to be determined. Unfortunately, the demons supply more 
information than is necessary for work extraction because they operate independently, 
which we see graphically in figure [ 2 ] through the inequality / Ml (A, Mfl + / Ma (A, M 2 ) > 
~i X (X ;M l5 M 2 ). 


7. Conclusion 

We have introduced a rehnement of the second law for many interacting, multipartite 
systems that each experience independent, uncorrelated noise. For such a collection of 
systems, the second law splits into a separate, positive contribution for each system. 
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Figure 2. Plot of the extracted work W ex t (solid black) and information flow 
—I x (X-,Mi,M 2 ) (black dashed) for a Brownian particle controlled by a pair of 
identical Maxwell demon’s as a function of the strength of the feedback force a.\ of the 
first demon. For comparison we have included the total amount of information gathered 
by the pair of demons I Ml ( X , Mi) + I M2 (X, M 2 ) (gray dashed). Other parameters are 
k = 2.5, kd = 1.5, p = 1, v = 2.5, and a 2 = 1. 




-1.00 - 0.75 - 0.50 - 0.25 0.00 0.25 0.50 0.75 1.00 1.25 1.50 -1.00 -0.75 -0.50 -0.25 0.00 0.25 0.50 0.75 1.00 1.25 1.50 

a i (*i 


Figure 3. (Left) Plot of the heat expended by the first demon Q A!l (black) to gather 
information J Ml {X\Mf) (black dashed), which exceeds the work it extracts Wffl (gray 
dot-dashed) as a function of the strength of the feedback force (Right) Same for 
second demon, M 2 . Parameters are k = 2.5, kd = 1.5, p = 1, v = 2.5, and a 2 = 1. 
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The interactions among the systems then manifests itself in this entropy balance by 
the appearance of an information flow that accounts for how each system learns about 
the others and utilizes that information. We then further refined this statement by 
recognizing that each system only directly interacts with a subset of all the other 
systems, a group we call its neighbors. As a result, the information flow can be 
restricted to a system and just its neighbors, which implies, among other things, that 
only information shared between a system and its neighbors can be used to perform a 
useful task. 

A careful analysis our results also reveals that our key requirement is that each 
system experiences independent noise. We do not need to require that these noises be 
generated by distinct thermodynamic reservoirs, though we have made this assumption 
for clarity of presentation. All we really need is to be able to track the thermodynamic 
flows from each system into the surroundings. Thus, for example, our results apply 
to a collection of small systems immersed in a common thermal reservoir, as long as 
the perturbations affecting each system from the reservoir are independent. Still, not 
all collections of systems where information dynamics are interesting will satisfy our 
multipartite assumption. In this direction, a growing amount of research has been 
focused on information reservoirs [naina ed HD 02], which do not have a multipartite 
structure. 

We further imagine that the analysis presented here will prove helpful in re¬ 
investigating the energetics of communication networks as outlined by Landauer [43], 
since such networks of communication channels are physically implemented by many 
interacting, small thermodynamic systems. Particularly intriguing examples are 
biochemical sensory networks responsible for transducing signals into and through cells, 
which can have a multipartite structure [29, ill], 03, HE 00, 37]. 
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